# Efficient Language Models

OpenELM is a set of open-source efficient language models that employ a hierarchical scaling strategy to optimize parameter allocation and improve model accuracy. It includes four parameter scales: 270M, 450M, 1.1B, and 3B, offering both pre-trained and instruction-tuned versions.

OpenELM is a set of open-source efficient language models that adopt a hierarchical scaling strategy to efficiently allocate parameters in each layer of the Transformer model, improving accuracy.